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1 

Intelligent System for Detection of Process Status, 
Process Fault and Preventive Maintenance 

[0001] This PCT application Is based on and relies for priority on United 
States Provisional Patent Application Number 60/524,846, filed November 26, 2003, 
the entire contents of which are incorporated herein by reference. 

Field of the Invention 

[0002] The present invention relates to control systems, particularly to a 
system in a semiconductor processing facility designed to monitor performance, 
predict failures and determine maintenance schedules. 

Background of the Invention 

[0003] Semiconductor processing techniques represent complex, non-linear 
physical environments wherein various process variables are under the control of an 
operator. Indeed, typically, an operator is in control of ten or more process variables 
that require constant monitoring. However, processing conditions can change over 
time, with small changes in critical process parameters creating undesirable results. 
These changes can easily occur in the composition or pressure of a processing gas, 
applied power, or wafer temperature resulting in the production of out of tolerance 
features on the semiconductor wafer. 

[0004] Re-entrant wafer flows, critical processing steps and maintenance 
requirements in a semiconductor manufacturing plant contribute to a complex control 
task usually performed by one or more computers in a computerized control system. 
This control system handles multivariate data, the analysis and display of data and 
provides real-time process control. 
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Summary of the Invention 
[0005] In accordance with at least one embodiment of the invention, an 
intelligent modeling method and system monitor and perfomi analysis of 
semiconductor processing equipment and predict future states of that equipment 
based on the analysis. 

[0006] In accordance with at least one embodiment of the invention, an 
intelligent modeling method and system monitor and perform analysis in a 
semiconductor processing facility to predict failures and detemnine equipment 
maintenance schedules. 

Brief Description of the Drawings 

[0007] A more complete appreciation of the invention and much of the utility 
thereof will become readily apparent with reference to the following detailed 
description of several embodiments of the invention, particularly when considered in 
conjunction with the accompanying drawings, in which: 

[0008] FIG. 1 illustrates a simplified block diagram of the reinforcement 
learning system designed in accordance with at least one embodiment of the present 
invention; 

[0009] FIG. 2 illustrates a simplified block diagram of the non-linear intelligent 
system according to at least one embodiment of the present invention; 

[0010] FIG. 3 illustrates a simplified diagram of a neural network; and 
[0011] FIG. 4 illustrates a flowchart demonstrating a method of determining 
maintenance scheduling on a semiconductor process tool in accordance with at least 
one embodiment of the present invention. 
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DETAILED DESCRIPTION OF SEVERAL EMBOl 

[0012] Various embodiments of the present invention are directed to intelligent 
modeling methods and systems that monitor and perfomn analysis of semiconductor 
processing equipment as well as predict future states of that equipment based on the 
analysis, predict failures of the semiconductor processing equipment and/or 
detemiine equipment maintenance schedules. 

[001 3] Accordingly, the system model may obtain data indicating process 
measurements and known variables, for example, the time or times of last cleaning 
or maintenance or the time or times of last failures, to predict failure, next cleaning, 
and/or preventative maintenance schedules. 

[0014] FIG. 1 illustrates a reinforcement learning system 100 whereby 
semiconductor processing equipment 110 outputs various process measurements 
120, such as chamber temperature, gas mixture and applied Radio Frequency (RF) 
power, which are input into the model 130. Known variables 140, such as the time 
between a last equipment cleaning interval and time between last equipment 
failures, may also be entered into the model 130. This model 130 then simulates the 
future equipment states to determine the next time that equipment maintenance 
should be necessary based on the gathered data and other variables. The model 
130 can then generate predictions 150, including predicted semiconductor 
processing equipment future states in near real-time and command or correction 
data, and transmit those predictions 150 to an equipment controller 160 coupled to 
or included in the equipment 110. 

[0015]This model-based process control is a mathematical model of the 
relationship of parameters to results in a given semiconductor manufacture process. 
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Models may be univariate or multivariate, linear or non-linear re! 
dynamic. 

[001 6] If the model is univariate, the univariate method may be designed to 
evaluate one variable at a time, although a second variable used to group or sort the 
variables may be implied. 

[001 7] If the model is multivariate, many independent and possible dependent 
variables may be analyzed. A large number of conventional software application 
programs can handle the complexity of large multivariate data sets. In a multivariate 
model, analysis of results is iterative and stochastic. For multivariate models, an 
appropriate data set may be composed of values related to a number of variables. 
Accordingly, appropriate data sets may be organized as a data matrix, a correlation 
matrix, a variance-covariance matrix, a sum-of-squares and cross-products matrix, 
or a sequence of residuals. 

[001 8] Static modeling may be performed after data collection for a wafer or 
lot has been completed; whereas, dynamic modeling may be performed in near real- 
time as data streams out of the manufacturing process. Models can be based on 
physical models of a process or on empirical results derived from observation of 
cause and effect within the process. 

[0019] In accordance with at least one embodiment of the invention, the 
process measurements 120 may be used in an intelligent system, such as a neural 
network building a model to output data indicating a prediction of a next failure time 
and a preventative maintenance schedule as illustrated in FIG. 1 . 

[0020] FIG. 3 is a simplified diagram of a neural networi< 300 that may be 
used to implement the non-linear model. As illustrated in FIG. 3, the neural networic 
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300 includes n+1 Input nodes, a variable number of hidden nodes, and n+1 output 
nodes. 

[0021] It should be understood that neural networks store connected strengths 
(i.e.. weight values) between the artificial neuron units. The weight value set 
comprising a set of values associated with each connection in the neural networic, is 
used to map an Input pattern to an output pattern. The set of weight values used 
between unit connections In a neural networic is the knowledge structure, teaming 
here is defined as any self-directed change in a knowledge structure that improves 
performance. "Learning" in a neural network means modifying the weight values 
associated with the interconnecting paths of the network so that an input pattem 
maps to a pre-determined or "desired" output pattern. 

[0022] In the study of neural networi^ behavior, learning models have evolved 
that consist of rules and procedures to adjust the synaptic weights assigned to each 
Input In response to a set of "learning" or "teaching" inputs. Most neural network 
systems provide learning procedures that modify only the weights- -there are 
generally no rules to modify the activation function or to change the connections 
between units. Thus, if an artificial neural networi< has any ability to alter its response 
to an input stimulus (i.e., "learn", as It has been defined), it can only do so by altering 
its set of "synaptic" weights. 

[0023] In accordance with at least one embodiment of the invention, a group 
of learning techniques classified as pattem association, is used. The goal of pattem 
association systems is to create a map between an input pattem defined over one 
subset of the units (i.e., the input layer) and an output pattem as it is defined over a 
second set of units (i.e.. the output layer). This process attempts to specify a set of 
connection weights so that whenever a particular input pattem reappears on the first 
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set (input layer), the associated output pattern will appear on the second set (output 
layer). Generally in pattern association systems, there is a "teaching" or "learning" 
phase of operation during which an input pattern called a "teaching pattern" is input 
to the neural network. The teaching pattern comprises of a set of known inputs and 
has associated with it a set of known or "desired" outputs. If, during a teaching 
phase, the actual output pattem does not match the desired output pattem, a 
teaming oile is invoked by the neural networi< system to adjust the weight value 
associated with each connection of the network so that the training input pattem will 
map to the desired output pattem. 

[0024]Virtually all of the currently used leaming procedures for weight 
adjustment have been derived from the learning rule of psychoanalyst D. O. Hebb, 
which states that if a unit, uj, receives an input from another unit, ui, and both are 
highly active, the weight, wj], in the connection from ui to uj should be strengthened. 

[0025] The Hebbian leaming mie has been translated into a mathematical 
formula: 

wji =g(aj(t),t,(t))h(0i(t),Wj,)(1) 
[0026] The equation states that the change in the weight connection Wji from 
unit Uj to U) is the product of two functions: g(), with arguments comprising the 
activation function of uj, aj (t), and the teaching input to unit uj, ^ (t), multiplied by the 
result of another function, h(), whose arguments comprise the output of ui from the 
training example, Oj (t). and the weight associated with the connection between unit 
Ui and uj, Wjj. 

[0027] This general statement of the Hebbian leaming rule is implemented 
differently in different kinds of neural network systems, depending on the type of 
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neural network architecture and the different variations of the Hebbian learning rule 
chosen. In one common variation of the rule, it has been observed that: 

h(Oi (t). Wji)=l| ( 2) 

and 

g(ai (t), tj (t))=H(tj (t)-aj (t)) (3) 

[0028] where i| equals the ith element of the output of unit Uj (or the input to uj), 
and H represents a constant of proportionality. Thus, for any input pattem p the rule 
can be written: 

pWji =H(tRi-Opj)lpi =H Ap,lpi(4) 

[0029] where tpj is the desired output (i.e., the teaching pattern) for the jth 
element of the output pattem for p, Opj is the jth element of the actual output pattem 
produced by the input pattem p, ipi is the value of the ith element of the input pattem. 
Apj is the "delta" value and is equivalent to tpj -Opj; this difference represents the 
desired output pattem value for the jth output unit minus the actual output value for 
the jth component of the output pattem. p wji is the change to be made to the weight 
of the connection between the Ith and jth unit following the presentation of pattem p. 

[0030] Thus, retuming to the detailed description of Figure 1, if the system is 
designed to leam from previous operations, within the equipment controller 160 or 
elsewhere within the system, predicted values may be compared with actual values 
that correspond to the predicted values and assigned a reward value. 170 for leaming 
by model 130. 

[0031] As illustrated in FIG. 2, in accordance with at least one embodiment of 
the invention, the intelligent system 200 may use a non*linear model 210 to predict 
maintenance schedules from processing measurements as illustrated in FIG. 2. 
The non-linear model 210 may be implemented, for example, as a neural network in 
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a reinforcement leanaing setting. Regardless of its implementation, the non-linear 
model 210 may be implemented to receive inputs 220 including a reward value, 
time(s) of the last equipment maintenance/failure, and a combination of various 
processing measurements. The non-linear model 210 may also be configured to 
produce outputs 230 including suggested maintenance schedules for semiconductor 
processing equipment, e.g., a semiconductor fabrication chamber. Thus, the non- 
linear model 210 may predict a time for a next failure to occur and/or when next 
maintenance will be required for the equipment. 

[0032] During configuration of the non-linear model as a tool used in 
conjunction with the semiconductor processing equipment, the model may be 
configured using offline simulations to completely model the semiconductor 
processing equipment, e.g., a chamber. The model may then be tested for reliability 
and validated. The reliability testing and validation may be performed by comparing 
previously predicted states with ongoing results. Accordingly, reward values may be 
implemented for continued learning and Improved future predictions. For example, 
when a predicted state matches an actual state, a reward value of zero may be 
assigned, whereas an incorrect prediction may trigger assignment of a reward value 
of one. 

[0033] The model may also be oin offline to fomnulate maintenance 
schedules, perform additional data analysis, and analyze effects of changes to the 
semiconductor processing system. For example, the model may be used offline to 
mn simulations for days and weeks in advance to formulate sen/ice maintenance 
schedules. In such a configuration, a data mining approach may be used to match 
the collected data regarding operation of the equipment with a need to perform 
maintenance and/or failure times. 
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[0034] For example, in such an approach, equipment operating parameters 
may be analyzed using some procedure, such as Principle Components Analysis 
(PCA), for finding relevant variables (components). This procedure may be used to 
analyze, for example, data collected during calibration and/or operation of the 
semiconductor processing equipment. 

[0035] Fortunately, in data sets with many variables, groups of variables often 
move together. One reason for this is that more than one variable may be measuring 
the same driving principle goveming the behavior of the system. In many systems, 
there are only a few such driving forces. PCA pemnits replacing a group of variables 
with a single new variable. 

[0036] PCA is a quantitatively rigorous method for achieving this simplification. 
The method generates a new set of variables, called principal components. Each 
principal component is a linear combination of the original variables. Because all the 
principal components are orthogonal to each other, there is no redundant 
information. Thus, the principal components as a whole form an orthogonal basis for 
the space of the data. 

[0037] PCA finds the eigenvalues and eigenvectors of a variance-covariance 
matrix or a correlation matrix. In accordance with at least one embodiment of the 
invention, a congelation matrix, e.g., using a nonnalized variance-covariance matrix, 
may be of particular utility because the collected data is in variables that are 
measured in different units; thus, some degree of normalizing of variables using 
division by their standard deviations may be necessary. 

[0038] In PCA, the eigenvalues, giving a measure of the variance accounted 
for by the corresponding eigenvectors (components) are given for the first n most 
important components. The percentage of variance accounted for by the 
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cx)mponents determines the degree of success in modeling. For example, if most of 
the variance is accounted for by the first one or two components, the model may be 
considered successful; however, if the variance is spread more or less evenly among 
the components, the modeling may be considered less successful. 

[0039]The non-linear model described hereto may be used in conjunction 
with, or include, an icon driven user interface as a front end that allows a user to 
interact with a user interface by clicking on an icon to retrieve data and take process 
measurements from the semiconductor processing equipment, e.g., chamber. 

[0040] In accordance with the mapping of historical processing measurements 
and maintenance and failure times discussed above, for the non-linear model, 
multiple processing measurements from historical data may be collected for training 
and testing data. Collected data used by the model may include, for example, past 
processing measurements including CD (critical dimension measurement), gap 
(electrode spacing). He (backside He pressure). P (process pressure), Pt (remaining 
processing time), Q (total flow rate), %Q (flow rate ratio among gases). RFb (bottom 
electrode RF power), RFt (top electrode RF power), T (chuck temperature), Vpp 
(peak to peak RF voltage), and/or Vdc (self-developed DC offset). 

[0041] Corresponding maintenance and chamber failure times may be 
gathered from historical data to determine maintenance schedules. The processing 
measurements are used as Inputs and the maintenance and/or failure times are 
used as outputs for training the neural network. For example, the non-linear model 
may have, for example, twelve input nodes (coresponding to CD, gap. He, P, Pt, Q, 
%Q, RFb, RFi, T, Vpp, Voc) and two output nodes, maintenance time and failure time. 

[0042] Once the non-linear model satisfies en^or bounds for the training, 
testing data may be implemented to verify the model. This verification may involve 
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cxDmparison of past predicted equipment states with corresponding actual equipment 
states. The model may then be setup for continuous training with new data in the 
learning system. 

[0043] In this continuous training, maintenance and failure times of the 
chamber are used to calculate a reward value. Thus, the reward value may be 
based on predicted maintenance times; as such the reward value may be as simple 
as the sum of the difference from the predicted maintenance/failure times to the 
actual maintenance/failure times. Thus, if the predicted times are close to the real 
maintenance/failure times, the reward value may be near 0. If the values differ the 
reward value may be large, 

[0044] FIG. 4 is a flow diagram demonstrating operation of a learning system 
and neural network model designed in accordance with at least one embodiment of 
the invention. The operation begins at 405 and control proceeds to 410, at which 
equipment processing measurements are collected, e.g., chamber measurements 
such as CD. gap. He, P, Pt, Q, %Q, RFb. RFt. T, Tmf. Vpp, Vdc and R. Control then 
proceeds to 415, at which a detemnination is made whether maintenance has been 
performed or a machine failure has occurred. If not, control proceeds to 420. If so, 
control proceeds to 425, at which a new reward value is calculated based on 
maintenance performed or the failure and any corresponding maintenance queue is 
cleared. Subsequently, control proceeds to 420. 

[0045] At 420. the reward value and processing measurements are sent to the 
non-linear model, e.g., the neural network and the nonlinear model is refomiulated if 
the reward value has been recalculated. Control then proceeds to 430, at which the 
predictions are calculated from the non-linear model; control then proceeds to 435 at 
which the maintenance schedule and failure prediction is sent to the controller 
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controlling operation of the chamber. Control then proceeds to 440. at which a 
determination is made whether maintenance is needed based on the predictions 
from the non-linear model. 

[0046] If maintenance is not needed, control returns to 410 for collection of 
additional processing measurements. If maintenance is needed, control proceeds to 
445 at which a detemiination is made whether the chamber is busy. If so, control 
proceeds to 455, at which a maintenance request is placed in a maintenance queue. 
Control then returns to 410 for collection of additional processing measurements. If 
the chamber is not busy, control proceeds to 450 at which a prompt Is issued to an 
operator to perform specified maintenance or the maintenance is performed 
automatically and control returns to 410 for collection of additional processing 
measurements. 

[00471This method of maintenance prediction can provide near real-time 
model based control and feedback of the chamber environment. 

[0048] Although not illustrated, modeling of the equipment, maintenance 
schedule formulation and failure prediction may be performed after data collection for 
a wafer or lot has been completed. In such an embodiment, there need not be real- 
time re-modeling of the semiconductor fabrication equipment. 

[0049] Moreover, the modeling may be more generally formulated for the 
model of semiconductor fabrication equipment rather than the particular piece of 
equipment. Thus, the model may be pre-fomiulated based on the type of equipment, 
e.g., a particular model number or production line of equipment, rather than on the 
particular piece of equipment itself. 
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[0050] Additionally, in accordance with at least one embodiment of the 
invention, the system may be pre-fomiulated based on the type of equipment but 
also be dynamically updated using the method illustrated in FIG. 4. 

[0051] In accordance with at least one embodiment of the invention, the 
operator may ovenide a system input with a value forcing a maintenance indication 
or a chamber fault indication. This overriding function may be used when an operator 
wishes to induce manual control of the maintenance of the semiconductor 
processing equipment or implement special processing or maintenance operations. 

[0052] After inttial development, the system model may make measurements 
of the equipment operating characteristics and predict current processing states and 
future states. The system model can determine current process status, maintenance 
schedules, data analysis, and effects of changes to the semiconductor fabrication 
equipment The model can also simulate operations days/weeks in advance for 
detemnining service maintenance schedules. 

[0053] Numerous modifications and variations of the present invention are 
possible in light of the above teachings. It is therefore to be understood that, within 
the scope of the appended claims, the invention may be practiced otherwise than as 
specifically described herein. 
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CLAIMS : 

What is claimed is: 

1 ) A method for detemiining a future state of semiconductor processing 
equipment, the method comprising: 

training a neural network model with semiconductor processing equipment 
process measurements to predict failure of the semiconductor processing 
equipment. 

2) The method of claim 1 , further comprising updating the model by 
applying at least one reward value calculated based on past model accuracy in 
predicting failure of the semiconductor processing equipment. 

3) The method of claim 1 , further comprising formulating a maintenance 
schedule for the semiconductor processing equipment based at least in part on the 
model. 

4) The method of claim 3, further comprising updating of the model by 
applying at least one reward value calculated based on past model accuracy In 
predicting maintenance requirements. 

5) The method of claim 3, wherein the maintenance schedule is 
fomiulated using an input data set produced by Principle Component Analysis. 

6) The method of claim 1 , wherein semiconductor processing equipment 
processing measurements include at least one of a time of last cleaning of the 
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semiconductor processing equipnnent, a time of last maintenance of the 
semiconductor processing equipment, a time of a last failure of the semiconductor 
equipment and a preventative maintenance schedule for the semiconductor 
processing equipment. 

7) The method of claim 1 , wherein the neural network outputs data 
including at least one of a suggested maintenance schedule for the semiconductor 
processing equipment, a suggested cleaning schedule for the semiconductor 
processing equipment and a predicted time for a next failure of the semiconductor 
processing equipment. 

8) The method of claim 1 , further comprising obtaining data indicating the 
semiconductor equipment process measurements used for predicting the failure of 
the semiconductor equipment. 

9) The method of claim 1 , wherein the processing measurements include 
at least one of chamber temperature, gas mixture and applied radio frequency 
power. 

1 0) The method of claim 1 , wherein the model is multivariate. 

1 1 ) The method of claim 10, wherein the model analyzes data sets 
organized as, a data matrix, a con-elation matrix, a variance-covariance matrix, a 
sum-of-squares, a cross-products matrix, or a sequence of residuals. 
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12) The method of claim 1 , wherein the model is dynamic and the model Is 
updated as processing measurement data is produced by the semiconductor 
processing equipment. 

1 3) The method of claim 1 , wherein the model is fonnuldted using offline 
simulations to completely model the semiconductor processing equipment. 

14) The method of claim 13, further comprising testing the model for 
reliability and validating the model by comparing previously predicted states with 
processing measurements produced by the semiconductor processing equipment. 

15) The method of claim 1, further comprising providing an icon driven user 
interface as a front end that allows a user to retrieve data and obtain processing 
measurements from the semiconductor processing equipment, 

16) A system for detenmining a future state of semiconductor processing 
equipment, the system comprising: 

a neural network model trained with semiconductor processing equipment 
process measurements to predict failure of semiconductor processing equipment. 

17) The system of claim 16, wherein the model is updatable by applying at 
least one reward value calculated based on past model accuracy in predicting failure 
of the semiconductor processing equipment. 
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1 8) The system of claim 16, wherein semiconductor processing equipment 
processing measurements include at least one of a time of last cleaning of the 
semiconductor processing equipment, a time of last maintenance of the 
semiconductor processing equipment, a time of a last failure of the semiconductor 
equipment and a preventative maintenance schedule for the semiconductor 
processing equipment. 

1 9) The system of claim 16, wherein the model formulates a maintenance 
schedule for the semiconductor processing equipment based at least in part on the 
model. 

20) The system of claim 19, wherein the model is updatable by applying at 
least one reward value calculated based on past model accuracy in predicting 
maintenance requirements. 

21 ) The system of claim 19, wherein the maintenance schedule is 
fomnulated using an input data set produced by Principal Components Analysis. 

22) The system of claim 19, the system further comprising a semiconductor 
processing equipment controller which receives data output from the neural network 
and including at least one of a suggested maintenance schedule for the 
semiconductor processing equipment, a suggested cleaning schedule for the 
semiconductor processing equipment and a predicted time for a next failure of the 
semiconductor processing equipment. 
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23) The system of claim 22, wherein the equipment controller uses the 
data output from the neural network in at least one servo control loop. 



24) The system of claim 23, wherein the at least one servo control loop 
provides one of Proportional-Integral, Proportional-Derivative, or Proportional- 
Integral-Derivative control, to maintain desired values of controlled variables for the 
semiconductor processing equipment. 

25) The system of claim 16, wherein the model obtains data indicating the 
semiconductor equipment process measurements used for predicting the failure of 
the semiconductor equipment. 

26) The system of claim 25, wherein the data obtained includes at least 
one of a time of last cleaning of the semiconductor processing equipment, a time of 
last maintenance of the semiconductor processing equipment, a time of a last failure 
of the semiconductor equipment and a preventative maintenance schedule for the 
semiconductor processing equipment. 

27) The system of claim 16. wherein the processing measurements include 
at least one of chamber temperature, gas mixture or applied radio frequency power. 

28) The system of claim 16, wherein the model is multivariate. 
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29) The system of claim 16, wherein the model is dynamic and the model 
is updated as processing measurement data is produced by the semiconductor 
processing equipment. 

30) The system of claim 16, wherein the model is fomnulated using offline 
simulations to completely model the semiconductor processing equipment 

31) The system of claim 16, further comprising an icon driven user 
interface as a front, end of the system that allows a user to retrieve data and take 
process measurements from the semiconductor processing equipment. 

32) A method for determining a future state of semiconductor processing 
equipment, the method comprising: 

predicting a maintenance schedule of the semiconductor processing 
equipment using a model detemiined from past performance based on 
semiconductor processing equipment processing measurements. 

33) A system for detenmining a future state of semiconductor processing 
equipment, the system comprising: 

a model determined from past perfonnance of the semiconductor processing 
equipment and configured to output data indicating a nriaintenance schedule of the 
semiconductor processing equipment based on semiconductor processing 
equipment processing measurements. 
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